Nested conformal prediction and quantile out-of-bag ensemble methods
نویسندگان
چکیده
Conformal prediction is a popular tool for providing valid sets classification and regression problems, without relying on any distributional assumptions the data. While traditional description of conformal starts with nonconformity score, we provide an alternate (but equivalent) view that sequence nested calibrates them to find set. The framework subsumes all scores, including recent proposals based quantile density estimation. these ideas were originally derived sample splitting, our seamlessly extends other aggregation schemes like cross-conformal, jackknife+ out-of-bag methods. We use derive new algorithm (QOOB, pronounced cube) combines four ideas: regression, cross-conformalization, ensemble methods predictions. develop computationally efficient implementation also used by QOOB. In detailed numerical investigation, QOOB performs either best or close simulated real datasets. Code available at https://github.com/aigen/QOOB.
منابع مشابه
Ensemble Methods for Structured Prediction
We present a series of learning algorithms and theoretical guarantees for designing accurate ensembles of structured prediction tasks. This includes several randomized and deterministic algorithms devised by converting on-line learning algorithms to batch ones, and a boosting-style algorithm applicable in the context of structured prediction with a large number of labels. We give a detailed stu...
متن کاملHierarchical Ensemble Methods for Protein Function Prediction
Protein function prediction is a complex multiclass multilabel classification problem, characterized by multiple issues such as the incompleteness of the available annotations, the integration of multiple sources of high dimensional biomolecular data, the unbalance of several functional classes, and the difficulty of univocally determining negative examples. Moreover, the hierarchical relations...
متن کاملOut-of-Bag Estimation of the Optimal Hyperparameter in SubBag Ensemble Method
This article may be used for research, teaching and private study purposes. Any substantial or systematic reproduction, redistribution , reselling , loan or sub-licensing, systematic supply or distribution in any form to anyone is expressly forbidden. The publisher does not give any warranty express or implied or make any representation that the contents will be complete or accurate or up to da...
متن کاملSecond-order Quantile Methods for Online Sequential Prediction∗
We aim to design strategies for sequential decision making that adjust to the difficulty of the learning problem. We study this question both in the setting of prediction with expert advice, and for more general combinatorial decision tasks. We are not satisfied with just guaranteeing minimax regret rates, but we want our algorithms to perform significantly better on easy data. Two popular ways...
متن کاملon the comparison of keyword and semantic-context methods of learning new vocabulary meaning
the rationale behind the present study is that particular learning strategies produce more effective results when applied together. the present study tried to investigate the efficiency of the semantic-context strategy alone with a technique called, keyword method. to clarify the point, the current study seeked to find answer to the following question: are the keyword and semantic-context metho...
15 صفحه اولذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pattern Recognition
سال: 2022
ISSN: ['1873-5142', '0031-3203']
DOI: https://doi.org/10.1016/j.patcog.2021.108496